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ABSTRACT 


•Shrinking*  and  'expanding^  operations  on  two- 
valued digital  pictures  are  useful  for  noise  removal,  as 
well  as  for  detecting  "dense^  regions  and  elongated 
parts  of  objects.  For  grayscale  pictures,  the  analogs  of 
shrinking  and  expanding  are  local  MIN  and  MAX  operations. 
These  operations  commute  with  thresholding;  thus  if  they 
are  applied  to  a grayscale  picture,  followed  by  threshold- 
ing, the  result  is  the  same  as  if  the  picture  were  first 
thresholded  and  shrinking  and  expanding  were  then  performed. 
Applying  MIN  and  MAX  operations  prior  to  thresholding  thus 
makes  it  possible  to  defer  the  choice  of  a threshold,  which 
may  be  easier  to  select  after  these  operations  have  been 
performed.  
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Shrinking  and  expanding  operations 


"Shrinking"  and  "expanding"  operations  on  two-valued 
digital  pictures  are  useful  for  noise  removal  and  segmenta- 
tion [1,  pp.  362-365  and  394-397]  . Let  11  be  such  a picture 
whose  points  all  have  value  0 or  1,  and  suppose  that  n suffers 
from  "salt-and-pepper  noise"  — in  other  words,  that  n con- 
tains regions  consisting  primarily  of  O's  with  a sprinkling 
of  isolated  I's  and  vice  versa.  We  can  remove  isolated  I's 
by  performing  a "shrinking"  operation,  in  which  I's  are 
changed  to  O's  if  they  have  O's  as  neighbors,  followed  by  an 
"expanding"  operation  in  which  O's  are  changed  to  I's  if  they 
have  I's  as  neighbors.  This  process  shrinks  large  regions  of 
I's  and  then  reexpands  them  to  (essentially)  their  original 
state;  but  it  annihilates  isolated  I's,  since  they  disappear 
under  the  shrinking  and  cannot  be  regenerated  by  the  reexpan- 
sion. In  fact,  this  process  destroys  any  set  of  I's  that  is 
no  more  than  two  pixels  wide.  Similarly,  expanding  followed 


by  shrinking  destroys  isolated  O's  (or  sets  of  O's  that  are  at 
most  two  pixels  wide) . 

More  generally,  if  we  use  k repetitions  of  shrinking 
followed  by  k repetitions  of  expanding,  we  eliminate  sets  of 
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n containing  dark  objects  on  a light  background,  but  which 
suffers  from  (grayscale)  " salt-and-pepper  noise"  — in  other 
words,  a sprinkling  of  light  points  on  the  objects,  and 
of  dark  points  on  the  background.  To  apply  shrinking  and  ex- 
panding to  n,  we  must  first  threshold  11  so  that  dark  points 
become  I's  and  light  points  become  O's.  Under  some  circxim- 
stances,  it  may  be  undesirable  to  threshold  n at  too  early  a 
stage  in  its  processing,  since  this  discards  most  of  the  in- 
formation about  the  gray  levels  of  the  points  of  11.  Thus  it 
would  be  desirable  to  define  analogs  of  shrinking  and  expand- 
ing that  can  be  applied  directly  to  grayscale  pictures. 

In  a two-valued  picture  consisting  of  O's  and  I's, 
shrinking  the  I's  is  equivalent  to  computing  the  logical  AND 
of  each  pixel  with  its  neighbors,  and  expanding  the  I's  is 
equivalent  to  logically  ORing  each  pixel  with  its  neighbors. 

In  the  theory  of  fuzzy  sets  [2],  the  analogs  of  AND  and  OR  are 
MIN  and  MAX,  respectively.  Thus  a reasonable  generalization 
of  shrinking  and  expanding  to  grayscale  pictures  would  be 
local  MIN  and  MAX  — i.e.,  replacing  the  gray  level  of  each 
pixel  by  the  minimum  (or  maximum)  of  the  gray  levels  of  it 
and  its  neighbors.  Clearly  these  operations  do  behave 
analogously  to  shrinking  and  expanding  — e.g.,  they  should 
be  effective  in  cleaning  up  grayscale  salt-and-pepper  noise. 
[Their  use  to  detect  elongated  parts  of  objects,  or  clusters 


i 

of  points,  still  requires  some  sort  of  thresholding,  since 
these  processes  depend  on  detecting  large  connected  components; 
but  this  thresholding  can  be  performed  at  a later  stage,  when 
it  may  be  easier  to  choose  a good  threshold.]  Note  also  that 
if  the  only  gray  levels  in  a picture  are  0 and  1,  local  MIN 
and  MAX  reduce  to  shrinking  and  expanding. 
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Local  MIN  and  MAX  commute  with  thresholdin 
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In  this  section  we  show  that  if  local  MIN  and  MAX  oper- 
ations are  applied  to  a picture  IT,  and  11  is  then  thresholded 
(using  any  threshold  t) , the  results  are  exactly  the  scune  as 
if  n were  first  thresholded  at  t,  and  shrinking  and  expanding 
operations  were  then  applied  to  the  thresholded  n.  This  im- 
plies that  there  is  no  need  to  threshold  a picture  in  order  to 
apply  shrinking  and  expanding  operations  to  it.  Instead,  we 
can  apply  the  analogous  set  of  local  MIN  and  MAX  operations, 
and  thresholding  can  be  deferred  until  afterwards  (when  it  may 
be  easier  to  choose  a good  threshold) . 

We  can  actually  prove  a more  general  result,  namely  that 
local  MIN  and  MAX  commute  with  any  monotonic  transformation  of 
the  grayscale.  Let  h be  such  a transformation,  so  that  for 
all  gray  levels  and  we  have  a z^  implies  h(Zj^)  i h(z2). 
Then  we  can  prove 

Proposition  1.  Local  MIN  and  local  MAX  commute  with  h. 

Proof;  Since  h is  monotonic,  the  neighbor (s)  for  which  the 
minimum  (or  maximum)  value  is  taken  on  remain  the  same  when 
h is  applied.// 

Corollary  2.  Any  sequence  of  local  MIN  and  MAX  operations 
commutes  with  h.// 

Corollary  3.  Any  such  sequence  commutes  with  thresholding. 
Proof;  Thresholding  is  a monotonic  grayscale  transformation.// 


These  results  imply 


followed  by  thresholding  produces  the  scune  result  as  threshold- 
ing followed  by  the  corresponding  sequence  of  shrinking  and 
expanding  operations. 


Proof:  This  follows  from  Corollary  3 and  from  the  fact  that, 

for  a picture  whose  only  gray  levels  are  0 and  1,  local  MIN 
is  the  same  as  shrinking  and  local  MAX  is  the  same  as  expand- 
ing . // 
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Examples 

Figure  1 shows  the  results  of  repeatedly  applying  local 
MIN,  and  then  repeatedly  applying  local  MAX,  to  three  noisy 
infrared  (FLIR)  images  showing  light  objects  on  a dark  back- 
ground, for  1,  2,  and  3 repetitions,  using  either  4 or  8 
neighbors  of  each  point  to  define  the  operations.  It  is  seen 
that  considerable  noise  cleaning  is  achieved.  Note  that  there 
is  also  some  smoothing  of  the  object  shape,  especially  for  the 
larger  numbers  of  repetitions;  this  is  particularly  noticeable 

for  the  smaller  objects  (Figs.  Ib-c) . Figure  2 shows  analogous 

t 

f results  for  an  artificial  picture  consisting  of  two  noisy 

E 

I rectangles  on  a noise  background;  here  again,  substantial 

noise  cleaning  is  obtained. 
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5.  Concluding  remarks 

By  Proposition  4 , if  we  apply  local  MIN  and  MAX  oper- 
ations to  a picture,  the  result  can  be  thought  of  as  encompass- 
ing the  analogous  shrinking  and  expanding  results  for  all 
possible  thresholdings  of  the  picture.  It  may  thus  be  pre- 
ferable to  use  local  MIN  and  MAX  operations  prior  to 
thresholding,  since  this  allows  the  choice  of  a threshold  to 
be  postponed.  Under  some  circumstances,  threshold  selection 
may  be  easier  after  the  operations  have  been  performed;  for 
excunple,  if  a picture  contains  dark  objects  on  a light  back- 
ground together  with  grayscale  salt-and-pepper  noise,  the 
noise  may  blur  the  valley  on  the  picture's  histogrcim  between 
the  peaks  representing  the  object  and  background,  so  that  it 
may  be  difficult  to  select  a good  threshold  that  separates 
these  peaks  (see  [1,  pp.  263-268]).  Figure  3 shows  the  histo- 
grams of  the  pictures  in  Figure  Ic;  note  that  a narrow  cleft 
develops  in  the  histogram  valley  as  a result  of  the  local 
MIN/MAX  processing. 

Shrinking  and  expanding  operations  would  be  most  easily 
implemented  on  a parallel  array  processor,  and  the  same  is 
true  for  local  MIN  and  MAX  operations.  On  a conventional 
computer,  one  pass  through  the  picture  is  required  for  each 
iteration  (or  iterations  can  be  combined  by  using  a larger 
neighborhood  of  each  pixel) . In  either  case,  the  computational 
cost  of  local  MIN  and  MAX  operations  is  slightly  higher,  since 
they  involve  numerical  comparisons  rather  than  logical  oper- 
ations. However,  this  higher  cost  may  be  offset  by  the 
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potential  advantages  of  local  MIN  and  MAX  in  permitting  the 
commitment  to  a particular  threshold  to  be  deferred. 
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APPENDIX  A 


SOME  PROPERTIES  OP  ITERATED  LOCAL  MIN  AND  MAX 

Let  II  denote  the  result  of  applying  n iterations  of 
local  MAX  to  n. 

Proposition  A.l.  11  (P)  is  the  maximum  of  the  values  of  II  within 

distance  n of  P. 

Note;  "Distance"  in  this  proposition  should  be  defined  as 
follows:  By  a path  of  length  m from  P to  Q is  meant  a 
sequence  of  points  P = Pq/Pj.'  •**'  ^m  ” ^ such  that  P^^  is  a 
neighbor  of  1 s-  i s.  m (where  "neighbor"  means  the  same 

thing  that  it  does  in  the  definition  of  local  MAX) . We  say 
that  Q is  within  distance  n of  P if  there  exists  a path  of 
length  n from  P to  Q.  Readily,  this  notion  of  "distance' 
satisfies  the  definition  of  a metric  on  the  set  of  points  of  n;  it 
is  positive  definite,  symmetric,  and  satisfies  the  triangle 
inequality.  Note  also  that  the  points  at  distance  1 from  P 
are  just  the  neighbors  of  P. 

Proof;  Let  D (P)  (the  "disk"  of  radius  n centered  at  P)  be  the 
n 

set  of  points  within  distance  n of  P.  We  first  show  that 

D (P)  = UD  , (Q) , where  the  union  is  taken  over  all  Q at  distance  1 
n Q n-1 

from  P (i.e.,  over  all  neighbors  Q of  P) . Indeed,  by  the  triangle 
inequality,  any  point  in  the  union  has  distance  a,  n from  P;  and 
conversely,  any  point  R at  distance  ^ n from  P is  at  distance  s,n-l 
from  some  neighbor  Q of  P,  since  a path  from  R to  P must  pass 
through  some  such  Q. 


We  can  now  prove  the  proposition  by  induction  on  n.  It  is 
true  by  definition  for  n = 1;  suppose  it  true  for  n-1,  so  that 

^ n—  1 ^ 

n ' ' (Q)  is  the  maximum  of  values  of  n within  distance  n-1  of  Q, 

for  all  Q.  Now  II  = (II  at  P is  the  local  MAX  of  the 

values  of  n ^ 'in  the  neighborhood  of  P.  By  the  first  paragraph 
of  the  proof,  this  is  just  the  maximum  of  the  values  of  II  within 
distance  n of  P.// 

Let  n ' ^ denote  the  result  of  n iterations  of  local  MIN 

applied  to  II.  Let  ii  = 1-n  (where  we  assume  that  the  range  of 
values  of  n is  [0,1], 

Proposition  A. 2.  n 

Proof:  The  local  MAX  Mata  given  point  in  if  is  taken  on  at  the 

same  neighbor  (s)  as  is  the  local  MIN  m at  that  point  in  II;  hence 
M = 1-m.  The  proposition  follows  immediately  for  n = 1;  and  by 
Proposition  A.l,  if  we  take  "local"  to  mean  "within  distance  n," 
the  same  proof  holds  for  any  n.// 

Corollary.  = 11^"”^  .// 

Proposition  A. 3.  ^ ^ H;  (II^  s H. 

Proof:  For  any  Q within  distance  n of  P,  by  Proposition  A.l  we 
evidently  have  (Q)  s n(p);  hence  the  MIN  (over  all  such  Q)  of 

the  n^^^(Q)'s  is  also  ^ n(P).  The  second  part  follows  similarly.// 

These  propositions  are  analogous  to  well-known  properties  of 
expand/shrink  operations  [1] : 

1)  If  we  expand  the  set  of  I's  in  a two-valued  digital 
picture,  n times,  we  obtain  the  set  of  points  whose 
distances  to  the  nearest  1 are  s n. 


2)  Expanding  the  I's  is  the  same  as  shrinking  the  O's,  and 
vice  versa. 

3)  If  we  expand  the  I's  n times,  and  then  shrink  the  result 
n times,  we  obtain  a set  that  contains  the  original  set 
of  I's.  If  we  shrink  the  I's  n times,  and  then  expand 
the  result  n times,  we  obtain  a 
the  original  set  of  I's. 


set  that  is  contained  in 


APPENDIX  B 


RELATIONSHIP  BETWEEN  LOCAL  MAX  OR  MIN  AND  FUZZY  DISTANCE 

Let  S be  the  set  of  I's  in  a two-valued  digital  picture,  and 
for  any  point  P,  let  d(P,S)  be  the  distance  from  P to  (the  nearest 
point  of)  S,  as  defined  in  Appendix  A.  When  we  expand  S,  we  add 
to  it  all  points  at  distance  1 from  it,  and  we  decrease  the  distance 
from  any  PJfS  to  S by  exactly  1.  This  appendix  introduces  the  concep 
of  distance  between  a point  and  a fuzzy  set,  and  shows  how  per- 
forming local  MAX  decreases  this  distance  by  1 (in  a certain  sense) . 
We  recall  that  a fuzzy  set  (defined  on  the  points  of  the  picture 
array)  is  a mapping  y of  these  points  into  the  interval  [0,1];  thus 
a picture  11,  if  we  take  its  gray  level  range  to  be  [0,1],  defines 
a fuzzy  set.  If  y takes  on  only  the  values  0 and  1,  it  defines 
an  ordinary  set  (the  set  of  points  mapped  into  1) . 

Given  a point  P and  a fuzzy  set  y,  we  define  a mapping  6 of 
the  positive  x-axis  into  [0,1]  by 

6 (x)  = max  y (Q) 

Q€Dj^(P) 

where  D^(P)  is  the  set  of  points  within  distance  x of  P.  Thus  6 (x) 
is  the  highest  y value  at  any  point  within  distance  x of  P.  The 
following  properties  of  6 are  immediate: 

1)  6 is  monotonic  nondecreasing,  i.e.,  x^^  * *2 

6 (Xj^)  i 6 (X2)  . 

If  y takes  on  only  the  values  0 and  1,  let  S be  the  set  of 
points  it  maps  into  1;  then  6 (x)  = 0 for  x < d(P,S),  and 


2) 


6 (x)  = 1 for  X ^ d(P,S).  Thus  if  p defines  an  ordinary 
set  S,  6 is  a step  function  whose  step  is  at  d(P,S). 


3)  If  y and  v are  two  fuzzy  sets  that  define  the  mappings  6^ 
and  6^,  respectively,  then  y s v implies  6^  ^ 6^. 

VJe  can  now  show  that  if  we  apply  local  MAX  to  y,  then  for  any 
point  P,  the  mapping  6 (x)  is  shifted  one  unit  to  the  left,  i.e.,  j 

it  becomes  6 (x+1) . Indeed,  suppose  that  the  new  6 (x)  = a;  thus  a 
is  « local  MAX  at  some  point  in  D^(P),  so  that  it  is  the  original 
value  at  a neighbor  of  some  such  point,  i.e.,  at  some  point  of  j 

D^^^(P),  which  implies  that  a ^ 6 (x+1).  Conversely,  let  6 (x+1)  = $ 

= y(Q),  where  then  Q has  a neighbor  in  D^(P),  so  that 

when  we  apply  local  MAX,  there  is  a point  in  whose  value  i:  3, 

implying  that  the  new  6 (x)  ^ 3. 

Note  that  the  analogous  result  for  local  MIN  (or  for  shrinking, 
in  the  non-fuzzy  case)  does  not  hold;  for  example,  when  we  shrink 
a set  S,  we  may  increase  the  distance  from  PtS  to  S by  much  more 
than  1.  On  the  other  hand,  shrinking  S is  the  same  as  expanding 
its  complement  S,  and  applying  local  MIN  to  y is  the  same  as  applying 
local  MAX  to  1-y  (see  Appendix  A) ; thus  we  have  analogous  results 
for  shrinking  and  local  MIN  in  terms  of  distance  to  the  (fuzzy) 
complement.  i 
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Figure  1.  Results  of  applying  repeated  local  MIN  and  repeated 
local  MAX  to  three  FLIR  images.  In  each  part,  the 
upper-left  picture  is  the  original;  the  second  column 
uses  4-neighbor  local  MINs  followed  by  4-neighbor 
local  MAXes  (1,  2,  and  3 repetitions,  in  the  first, 
second,  and  third  rows) ; and  the  third  column  is 
analogous,  using  8-neighbor  operations  (i.e.,  includ- 
ing the  diagonal  neighbors) . 


Figure  2.  Analogous  to  Figure  1,  using  an  artificial  picture 

consisting  of  noisy  rectangles  on  a noisy  backgroud. 
(Mean  gray  levels  20  and  40,  and  standard  deviation 
5,  on  a 0-63  grayscale.) 


Figure  3.  Histograms  of  the  pictures  in  Figure  Ic.  Note  the 
development  of  a cleft  at  the  bottom  of  the  histo- 
gram valley. 


^ i-i 


M OMa  Kni»f4) 


REPORT  DOCUMENTATION  PAGE  befoIe'’co5ple?ino  form 


2.  OOVT  ACCESSION  NO.  S.  HEClFlCNT’S  CATAUOC  NUMBER 


4.  TITLE  (mH  luMlU) 

A NOTE  ON  THE  USE  OF  LOCAL  MIN  AND  MAX 
OPERATIONS  IN  DIGITAL  PICTURE  PROCESS- 


AUTNORfa) 


Yasuo  Nakagawa 
Azriel  Rosenfeld 


S.  TYRE  or  rerort  b rerioo  covered 
Technical 


S.  RERFORMINO  ORO.  RERORT  NUMBER 

TR-590 


S.  contract  or  grant  NUMBERfaJ 

DAAG53-76C-0138 


10.  RROGRAM  element.  RROJECT,  TASK 
AREA  4 WORK  UNIT  NUMBERS 


t.  RERFORMINO  OROANIZATION  NAME  AND  ADDRESS 

Computer  Science  Ctr. 
Univ.  of  Maryland 
Colleqe  Park,  MD  20742 


M.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

U.  S.  Army  Night  Vision  Lab. 

IIS.  NUMBER  OF  RAOES 

Ft.  Belvoir,  VA  22060  [ 


M^NlfoKlHO  AGENCY  NAME  4 ADDRESSfll  Blllarant  trom  Cantniling  Olllct)  I IS.  SECURITY  CLASS.  <0l  Ihlt  npcrt) 


12.  RERORT  DATE 

October  1977 


I 


UNCLASSIFIED 


4.  distribution  statement  (et  lhl»  RtRari; 


Approved  for  public  release;  distribution  unlimited. 


IT.  DISTRIBUTION  STATEMENT  (ol  Ma  aSatracI  aniarad  In  Block  20,  II  dlllorcnl  /ram  Ropetl) 


It.  KEY  WORDS  /Can/lnwa  an  favaraa  oldo  II  naeaaaaqr  end  Idonllly  by  Mack  numbar; 


Image  processing 

Shrinking 

Expanding 


Local  operations 
Noise  cleaning 


10.  ABSTRACT  i.-onilmia  an  raaaraa  a/4a  If  naeaaaarjr  anW  IWao(/f>- br  blotk  miBibar;  "Shrinking"  and  expand- 
ing" operations  on  two-valued  digital  pictures  are  useful  for  noise 
removal,  as  well  as  for  detecting  "dense"  regions  and  elongated 
parts  of  objects.  For  grayscale  pictures,  the  analogs  of  shrinking 
and  expanding  are  local  MIN  and  MAX  operations.  These  operations 
commute  with  thresholding;  thus  if  they  are  applied  to  a grayscale 
picture,  followed  by  thresholding,  the  result  is  the  same  as  if  the 
picture  were  first  thresholded  and  shrinking  and  expanding  were  then 

d MAX  operations  prior  to  thresholding 


DO  I jAtTn  1471  EDITION  OF  I NOV  41  It  OBtOLETE  UNCLASSIFIED 

SECURITY  CLAMIFICATlON  OF  TNII  RAGE  rWRan  Data  EnlaraO 


EDITION  OF  I NOV  tt  It  OBtOLETE 


r r 

UNCLASSIFIED 

»tCuWlTv  CLOMlFIOTtOW  OF  TWU  »A0«<Wl1  Omim  ImwO 


ABSTRACT  (cont'd) 


thus  makes  it  possible  to  defer  the  choice  of  a threshold,  which 
may  be  easier  to  select  after  these  operations  have  been  performed. 


UNCLASSIFIED 


StCOHITY  CLAtSiriCATION  OF  THIf  FAe£(TP»«#i  Df 


J 


